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Abstract 

In this paper we establish the Bahadur-Kiefer representation for 
sample quantiles of GARCH sequences with optimal rates. 
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1 Introduction 

Over the last years it was observed that (financial) data can be modeled 
appropriately by the Autoregressive Conditionally Heteroskedastic (ARCH) 
sequences, introduced by Engle ^3]. This model has been generalized later 
to GARCH sequences, see e.g. [S]. A GARCH(p, q) process is defined by 

Xk = CTkEk, (1) 
P <? 

4 = S + Y1 + E a i x l-r ( 2 ) 
1=1 j=l 

where 5 > 0, fy, 1 < i < p and ctj, 1 < j < q are nonnegative constants. We 
assume that {e^, — oo < i < oo} are i.i.d. random variables with distribution 
H. Under appropriate conditions on coefficients (5i and ctj these equations 
(P) and © have a unique stationary solution, see 0. In particular, let 

r„ = (A + ai4, ft, ... , /Vi) 6 BP' 1 
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and 



£ n = (4,0,...,0)e]Rr 1 , 



a 



(a 2 ,... 1 a q -i) € R 9 x . 



Further, the (p + q — 1) x (p + g — 1) matrix A n is defined by 



A n 



T~n Pp 





a a q 





V 2 



where I r is the identity matrix of size r. Let 1 1 ■ 1 1 be the matrix norm. Then, 
under the condition E(log + < oo, we have 



7 = lim — log I |y4o^-i • • • A- 

n — >oo 77, 



almost surely. Bougerol and Picard [7j showed that the unique stationary 
solution exist if and only if 7 < 0. 



The aim of this paper is to obtain the Bahadur-Kiefer representation 
for sample quantiles in case of stationary GARCH sequences. To state our 
results, assume that the stationary sequence {Xi,i > 1} has marginal dis- 
tribution function F(x) = P(X\ < x) and a density / = F' . Given the 
sample X%, . . . , X n , let F n (x) = i Yh=i ^{Xi<x} be its corresponding empir- 
ical distribution function. Let Xi :n < • • • < X n:n be the order statistics. 
The empirical quantile function Q n (y), y € (0, 1) is defined as Q n (y) = Xk- n 
if ^ <P < \. Further, let 

Pn(x) = n l ' 2 {F n {x) - F(x)), x E R , 

q n {y) = n 1/2 {Q(y) - Q n {y)), ye (0,1), 

be the empirical and the quantile processes, respectively. Since F is con- 
tinuous, we may define U{ = F(X{), i > 1. Let E n (x) = ^ J2i=i ^{Ei<x} = 
F n (Q{x)) and G n {y) be the corresponding uniform empirical distribution 
and uniform empirical quantile functions. Let 

a n {x) = n l/2 (E n (x) - x), x E [0, 1] , 

7n(y) = n 1/2 (y-G„(y)), y € (0, 1) , 
be the corresponding uniform empirical and uniform quantile processes. 

Assume for a while that Xj, i > 1 are i.i.d. Kiefer [2U], continuing his 
previous research ( JH]) and that of Bahadur ( 2 ) obtained, in particular, 
the following Bahadur-Kiefer representation: 

sup \u n (y) - a n {y)\ =: R n (3) 
ve[o,i] 
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and 



Rn = O a . s (n 



!/ 4 (log n) 1 ' 2 (log log n) 1 / 4 ). 



(4) 



The above rate is exact and constants can be given, see e.g. As for 

the general quantile processes the best available result is due to Csorgo 
and Revesz, !) . Under appropriate conditions (so called Csorgo- Revesz 
conditions) on the distribution F, we have 



sup \f(Q(y))q n (y) - a n {y)\ = O^n-^Oogn^Ooglogn) 1 / 4 ). (5) 



We refer to (HJ as well as to (23 for more discussion. 

For weakly dependent random variables some results are available. For 
mixing sequences the best possible (in terms of the rates for R n ) results 
are included in pQ. In particular, for a class of 0-mixing sequences, they 
obtained © with the optimal rate (j3J. Those results were improved in 
|15j and |24| in terms of less restrictive mixing rates and Csdrgo-Revesz 
conditions. However, the rate was R n = O a . s ((logn) _A ) with some A > 0. 
This rate is much worse compared to the optimal one in 

However, mixing is rather hard (if possible at all) to verify and requires 
some additional regularity assumptions. In particular, for linear processes 



in order to obtain strong mixing both regularity assumptions on a density of 
ei and some constrains on c^'s are required (cf. ^ c k decay exponen- 

tially fast and some regularity assumptions hold, then we are able to estab- 
lish the strong mixing with geometric rates. However, even in this case we 
do not attain the optimal rate in the Bahadur-Kiefer representation, see [Q. 
To overcome such problems, Ho, Hsing, Mielniczuk and Wu (see . 
|17j . |22| ) developed a martingale based methods, which leads to optimal or 
almost optimal results, especially in a context of weak convergence. Based 
on this method and restricting to an interval [yo, yi], < yo < y\ < 1, Wu 
|22j obtained for a class of linear processes as well as for a class of weakly 
dependent sequences satisfying a geometric moment contraction assump- 
tion, almost optimal rates in the Bahadur-Kiefer representation for linear 
processes. 

Coming back to the GARCH processes, we note that under appropriate 
conditions on moments and a density h of H(x) = P{e\ < x), the sequence 
{Xf}, and consequently {Aj}, is strongly mixing with a geometric rate. 
However, in view of pQ, the rates are not optimal. Therefore, in this paper, 
we shall obtain the Bahadur-Kiefer representation for GARCH sequences 
with the optimal rate. We note that to do this we need, essentially, two 
types of results. First, we need an uniform law of the iterated logarithm 



2/6(0,1) 



oo 




(6) 
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(ULIL) for the empirical process based on GARCH sequence. Second, we 
need to control increments of the empirical process. The ULIL will be a 
consequence of Berkes and Horvath [I] strong approximation result. Incre- 
ments will be controlled using the martingale approximation as introduced 
in [221 ■ We note, that the situation is complete different compared to lin- 
ear processes, namely, in this case, it is easy to control increments, see [221 
Section 6.3]. In case of GARCH processes, due to the lack of linearity, the 
situation becomes much more involved. 

We should also mention (personal communication with Wei Biao Wu) 
that for GARCH sequences, the Bahadur representation with the optimal 
rates can be obtained using the same technique as in |22l Theorem 1]. 

In what follows, C will denote a generic constant which may be different 
at each of its appearances. Also, we write a n ~ b n if bim^oo a n /b n = 1. For 
any stationary sequence {Zi, i > 1} of random variables, Z will be a random 
variable with the same distribution as Z\. 

Throughout the paper we shall use: 



-n- 3/4 (logn) 1/2 (loglogn) 1/4 

and 



A„ = n- 1/2 (21oglogra) 1/2 . 
For any function h(x) defined on 1R we write for x < y, h(x, y) := h(y)—h(x). 

2 Statement of results 

Note that F(x) = P(X < x) = EH(x/a). Thus, f(x) = Ea~ 1 h{x/a) and 
f'{x) = —Ea~ 2 h'(x/a). Consequently, via a > 5, if 



(HI) sup \h'{x)\ < oo, (H2) inf h(x) > 0. 



then also 



(Kl) sup |/'(Q(y))|<oo, (K2) inf f(Q(y)) > 0. 
ye(o,i) 2/e(o,i) 

The main result of this paper is following. 

Theorem 2.1 Consider the stationary GARCH model. Assume that 

Ee 4 < oo. (7) 

Assume (HI) and (H2). Then 

sup \f(Q(y))q n (y) - a n (y)\ = O^^n" 1 / 4 (log n) 1 / 2 (log log n) 1 / 4 ). 

3/6(0,1) 



4 



Remark 2.2 For a general F, the above result holds if one restricts to [a, b], 
< a < b < 1. To have estimates on (0, 1) one could follow the path of [S] 
or like in |24| . However, this is out of scope of our paper. Our main concern 
was to obtain the optimal rates. 

3 Proof of the Theorem 

3.1 Variance bound 

Let Ti = a(£i,£i-x, . . . , ). Write 



-E(W- } -^)) = 

i=l 

-, n 1 n 

= -E - E(i {Xl <, } i^-i)) +-£( E ( 1 {^<*}l^-0 - ^ 

n 1 n 

= -E (*{*<<<c} -E(l{x 4 <,}|^i-i)) + -E y *( x ) = : + iV n (x). 

Then nM n (x), n > 1, is a martingale. Also, since cr, is .Fj-measurable and 
£i is independent of .Fj one has E(l{_ x - i <a;}|^ r i-i) = H(x/ai). 

Proposition 3.1 Under the conditions of Theorem \2.1V 

\\nN n (x,y)\\l < D n\y - x\ 
with some finite and positive constant Dq. 

The proof of this will be divided into several steps. First, we have 



\nN n (x,y)\\ 2 

n / . y / a 



(H(x/ai, yjoi) - EH(x/ai, y/at)) 



i=l 



y/°~i 



I / h(u)du - E / h(u)du 

i=l \J x /°i Jx/oi 

n / 1 1 ' 1 



1=1 



<7; CTj 



h{u)du 



< C\y — x\ x 



i=l 



E -4 



C7,; C7,' 



Thus, it suffices to show 

Proposition 3.2 Under conditions of Theorem \2.1\ 



i=i 



Ci <7,; 



0(n). 
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Let us start with several results, which will be needed in the sequel. First, 
under conditions of Theorem 12.11 

oo 

]T Cov(X 2 ,X?)<oo, (8) 

i=— oo 

(see Theorem 2.5]). Next, the conditional variances a k can be represented 
in terms of ARCH(oo) sequences: 

oo 

a 2 k = a + J2 b i X k-i (9) 

i=l 

with nonnegative and summable coefficients bi, see |18j and references therein. 
Therefore, by ©, © and stationarity 

oo oo oo oo 

£ Cov(a 2 ,a 2 k ) = £ £ Cov(X^, X fc %.) < oo. (10) 

k=0 i=l j=l fc=0 

The proof of Proposition 13 . 21 will use a particular type of dependence struc- 
ture, the so called association. 



3.1.1 Association 

Random vectors R± , . . . , with values in Ji d are associated if for all coor- 
dinatewise nondecreasing functions /, g : lR kd — > H we have 

Cov(f(R 1 ,...,R k ),g(R 1 ,...,R k ))>0 (11) 

whenever the covariance is defined. A sequence {Rk}k>i is associated if (|llj) 
holds for all k > 1. 

This concept of weak dependence was introduced (in the scalar case) in 
|14j and has been widely studied since then, see e.g. [2^] and references 
therein. We shall need the following properties: 

(Al) Independent random variables are associated. 

(A2) Increasing transforms of associated random variables are associated, 
i.e. if (Z±, . . . , Z m ) are associated and /j, i = 1, . . . , k are coordinate- 
wise increasing, then R 1 = fi(Zi, . . . , Z m ), ...,R k = fk(Zi, Zm) 
are associated. 

(A3) A subset of associated random variables is associated. 

( A4) If T-jy , . . . , Tn^ are associated for each k and (T^ , . . . , ) — > (T% ,T n ) 
in distribution as k — > oo, then 7\, . . . , T n are associated. 

Lemma 3.3 Under the conditions of Theorem \2.1\ the sequence {X?, — oo < 
k < oo} is associated. 
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Proof. The solution to {U is given by Y n = B + A n A n _i ■ ■ ■ A n _kB, 

where 

Y n := (Y n (l), ... , Y n (p + q—l)) = (a^-li • • • > °"n-p+2> A 2 , • • • > A 2 _ ?+2 ). 

Then A 2 is identical with the (p + l)th coordinate of Y ra . Define Y n ( m ) = 
f? + SfcLo A n A n ^\ ■ ■ ■ A n _kB and A 2 , « respectively. Since the expres- 
sion on the right hand side in the preceding summation involves the in- 
creasing transformation of i.i.d. random variables, then by (Al) and (A2), 
Y n r m \(l), . . . , Y n r m \(p + q — l), the coordinates of Y n r m \ are associated for 
each fixed m and n. Further, for arbitrary but fixed k, a family Y n r m \ (1), . . . , Y n ^ m ^ 
q — 1), n = 1, . . . , k, is associated for each m. Therefore, by (A3), for arbi- 
trary k the random variables Xij m \, . . . , A fcj ( m ) are associated. Now, since 
for each i, -X» ( m j — > A, almost surely asm^oo (see e.g. Lemma 3.2]), 
the result follows by (A4). 



In view of @, Lemma 13.31 and using the same truncation argument we 
obtain the following corollary. 

Corollary 3.4 Under the conditions of Theorem \2. 1\ the sequence {cr 2 ,, — oo < 
k < oo} is associated. 



3.1.2 Proof of Proposition E21 

Let g(x) = x~ 1/2 . Let |bll[5,oo) = sup xg[(5i0o) \g(x)\. Then, for any (S > 0), 
lb'll[<5,oo) — (2(5 3//2 ) _1 . Therefore, we have 



J2{9(vf)-Eg(a[ 

i=l 

^Var^K 2 ) + 2j2Cov(g(af),g(a])) < nVar 5 (a 2 ) + 2\\g% iQo) £ Cov(* 



i=i 



4<J 



where the last estimate follows by Corollary 13 . 41 and using standard moment 
bounds for associated sequences, see [HI Lemma 3.1]. Now, the result follows 
by (|1U|) and the Kronecker lemma. 







3.2 Exponential inequality 

From Proposition 13.21 and the martingale approximation, 

2 



i=i 



< D\n{y — x) 



:i2) 
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with some D\ > 0. 

Choose an arbitrary p £ (0, j). As in the proof of Lemma 13.31 consider 
Yj and Y< := Y^ton, [•] being the integer part. Define Xi in such the way 
that Xf agrees with (p + l)th coordinate of Y, and the sign is that of £j. 
Let 

Xi{x) = l {Xl < x } ~ F{x), Xi{x) = l { x^ x} - El { ^< x} . 

Choose an arbitrary v > 8. Choose \i so big so that — 2)/(4z/) > 1. By 
we have E(log + l^l)^ < oo. Consequently, via Remark 1.2 in [3], their 
condition (1.6) is fulfilled. Then, as in [3J Lemma 2.4], 

p{\Xi -Xi\> ci- p ^-^i^) < cr^f- 2 '/ 4 

and consequently (cf. [3J Lemma 2.5] with 8 = 1 by differentiability of H) 

P(X J (x,y)/X l (x,y))<Cr^- 2 )/ 4 . 
Therefore, with v as above 



P 



y) -Xi(x,y)) > z < 



E"=l (E|X t (x,2/)-A-(:E,y)P 



\i=l 



< 



(E"=i r^~ 2 )/( 4i/ ) 



< Cz' v . 



(13) 



Further, in view of (|12|) and as in 1|13|) . 



£X;(x,y) <£>in(y-x) 



(14) 



if n(y — x) — > oo. Thus, we formulate all results below under this constrain. 



Lemma 3.5 Under the conditions of Theorem \2.1l for any z > 



J2Xi(x,y) 



i=l 



> z < C i z- I/ +C 2 exp(-C3Z 2 /(^(y-^)))+C4exp(-C 5 z/^), 



where C±, C2, C3, C4, C5 are positive constants and v > 8. 

Proof. From ()13|) and Markov inequality one gets 

V(\nN n (x,y)\ > z) < C lZ ~ u + 1P(\nN n (x,y)\ > z/2). 

To obtain the bound for the second part, divide [1, n] into blocks h, Ji, h, J2, ■ ■ ■ , Im, Jm 
with the same length n p , p as above. Thus, M ~ n 1_p . Let = J2i<=i k X{(x, y), 
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Vk = J2ieJ k M*,y) and nfrP = Y&i&k, nN® = E^liH- Both 
(Ui, . . . , Um) and (Vi, . . . , Vm) are vectors of independent random variables. 
Also, max&=i ... j\f t7jt < [Ifc] < Cn p . The relation (|14|) yields Hf/jtlH < 
D\n p {y — x). Applying the result in [21, p. 293] to the centered sequence 
Ui, . . . , Um with M n = n p , B n = D\n{y — x) one obtains 

F(\nN^ | > z) < exp(-Cz 2 /(4D in (y - x) 2 )) + exp(-Cz/(4n p )). 

a /2 s ) 

The same applies to P(|niVA | > £J and hence the result follows. 





Remark 3.6 Note that the proof of Lemma 2.8 in [Ij has a gap. The result 
from is applied to a non-centered sequence. 

3.3 Almost sure behavior of increments of the empirical pro- 
cess 

Recall that X; L (x) = l{Xi<x\ ~ F( x ) and let Ui(x) = liUi<x} — x. Then 
F n {x) - F(x) = ^EtiMx) and E n (x) - x = ^ £™ =1 Let b* n = 



Lemma 3.7 Under conditions of Theorem \2.1\ one has 

sup \F n (y) - F n (x) - (F(y) - F(x))\ = O a . s (b* n ). 

x,y£~R,\x—y\<\ n 



(15) 



Let \y — x\ < 1. Since F is differentiable with the strictly positive derivative 
we obtain that for a sufficiently small and positive h and \y — x\ < h one has 
C 6 (y-x) < F(x,y) < C 7 (y-x), C 6 ,C 7 > 0. Thus, with C 8 = C 3 C 6 /(4£>i), 



P 



J2Xi(x,y) 



i=i 



> z 



< C lZ ~ v + C 2 exp(-C 8 z 2 /(nF(x,y))) + C±exp(-C 5 z/ n P). 
Substituting Ui = F(Xi), u = Q(x), v = Q{y) one obtains 



P 



i=l 



>C 8 zj 

< C x z~ v + C 2 exp{-C 8 z 2 /(n(v - u))) + C 4 exp(-C 5 z/n p ). (16) 
First, we show that 

\E n (u) - E n (v) -{u-v)\= O a . s (b* n ). 



sup sup 

ue[o,i] ve[o,i],\u-v\<\ n 



(17) 
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Let e n = [l/(bn)] + 1, d n = [A n /(6*)] + 1. Note that both e n , d n diverge to 
oo. Note that the latter expression is bounded by 

max {max \E n ((i + j)b* n ) - E n (ib* n ) - jb* n \} + 2b* n . 

\]\<d n Ke„ 

Let D > 2 1 / 2 (C 8 )~ 1 / 2 . Using ("""EJ) with z = Dnb* n , bearing in mind p £ (0, \) 
and noting that e n d n = O(n), 

P{ max {max \E n ((i + j)b n ) - E n (ib n ) - jb n \} > Dnb* n ) 

\j\<dn l<c n 

< e n d n sup sup P(\E n (u) - E n (v) - (u - v)\ > Dnb* n ) 

uG[0,l] u6[0,l],|«—u|<A„ 

= 0{n(nb* n y u ) +o(nn" C8132 ) + 0(n exp(-Cn w )), 

with u > 0. By the choice of D and v > 8, the bound is summable and thus 
(|17|) follows by the Borel-Cantelli lemma. 

Substituting u = F(x) and v = F(y) into (jTTj) we obtain the result. 





3.4 Conclusion of the proof of Theorem 12.11 
By Lemma 13.51 we have 

sup sup \(3 n (x) - (3 n (y) \ = O a . s {b n ). 

x<=R \x— y\<\ n 

From [1] one has 

limsup(loglogn) _1//2 sup \(3 n (x)\ = C almost surely. (18) 

ra^oo — cxd<3;<oo 

If (|18[) holds then taking Ui = F{Xi) one obtains the same result for the 
uniform empirical process. Thus, via sup ye ( ,i) |7n(y)| = su Pj/e(o,i) \ a n(y)\, 

limsup(loglogn) _1//2 sup |7n(^)| = C almost surely. (19) 

n^oo — oo<a;<oo 

Further, if (H1)-(H2) are fulfilled, 

limsup(loglogn) -1 ^ 2 sup \q n (x)\ = C almost surely. (20) 

n— *oo —oo<x<oo 

On account of ((2*0]) we have 

sup \p n (Qn(y)) - (in{Q(y))\ = O a . s {b n ). 
i/e(o,i) 

Equivalently, 

n 1 / 2 sup \F n (Q n (y)) - F(Q n (y)) - (F n (Q(y)) - F(Q(y)))\ = O a . s (b n ). 

2/6(0,1) 
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Since \F n (Q n (y)) — F(Q(y))\ < 1/n one obtains 

n 1 ' 2 sup \F{Q n {y))-F{Q{y))-{F{Q{y))-F n {Q{y)))\=O a . s (bn)- 

3/6(0,1) 

Set A n ^ = Q n (y) — Q(y)- Using the Taylor's expansion F(Q n (y)) = 
F{Q{y)) + f{Q(y))A n , y + O a . s {^ y ) we finish the proof of TheoremO 
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